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A • 


SCOPE 


1.1 GENERAL 

This specification establishes the design specifications and 
describes modifications made to the Data Transformation processor 
of the EOD-LARSYS system to satisfy the requirements specified 
on the IDSD category 1 (Job Order 81-127) task agreement titled, 
"Data Transformation Program Modification", dated 6/11/76. The 
EOD-FCMO reference for the task is TIRF (Transmittal Information 
Request Form) 76-0078. 


2. APPLICABLE DOCUMENTS 


The following documents, of exact issue shown, form a part of 
this specification to the extent specified herein: 

• EOD'LARSYS Users Document: LEC 3984 Revision II 

• Task Description and Agreement, dated 6/17/76, "Data Trans* 
formation Program Modification" 


• EOD-FCMO TIRF 76-0078 


3. SYSTEM DESCRIPTION 


3.1 HARDWARE DESCRIPTION 
N/A 

3.2 SOFTWARE DESCRIPTION 

The Data Transformation processor of the EOD-LARSYS system is 
modified to include an optional additive transformation bias 
vector, optional input and application of scaling parameters, 
to allow the scaling parameters used by the processor to be 
output on punched cards in processor control card format, and 
to allow for a transformation matrix with up to sixteen (16) 
linear combinations (i.e., up to 16 x 30 transformation matrix). 

The application of the input transformation matrix was removed 
from subroutine LNTRAN and TRHIST and replaced with a subroutine 
called TRANSF, which implements the transformation of the input 
data vectors. The optional input transformation bias vector is 
incorporated in the transformation implemented in TRANSF. 

Previously all transformed data values were arbitrarily scaled 
to a range of 0-256. This procedure has been changed so that 
no rescaling will be applied unless a processor control card, 
"RESCALE", is input directing the processor to scale the trans- 
formed data to a range 0-255. If scaling is requester, either 
the same (histogram or statistical) procedures as before are 
used for scaling or the scaling parameters are input to the 
processor by an "OPTION SCAFAC" control card. 

The "OPTION PUNCH" processor control card initiates the punched 
card output of the scaling parameters used by the processor. 

These scaling parameters may be used as input in subsequent runs, 
without modification to the card(s) . 


3.2.1 SOFTWARE COMPONENT NO. 1 (DATATR) 


( 

3. 2. 1.1 Linkages 

DATATR is the driver program for Data Transformation processing 
and aS called by MONTOR, the LARSYS executive program. DATATR 
may call SETUPS, SETREM, KBTRAN, MAXMAT, TRHIST, or LNTRAN 
during processing. 

3. 2. 1.2 Interfaces 

DATATR utilizes common blocks GLOBAL, INFORM, and TRBLCK. 

3. 2. 1.3 Inputs 

Calling arguments unchanged in DATATR. 

3 . 2 . 1 . 4 Outputs 
None 

3. 2. 1.5 Storage Requirements 

Storage used: Code - i67g. Data - 4171g 

3. 2. 1.6 Description 

DATATR controls the Data Transformation processing. To determine 
which options are to be exercised during processing, SETUPS is 
called to read the Processor Control Cards. If scaling parameters 
are input by control cards, SETREM is called to initialize the 
arrays CON and MIN with the scaling parameters from the input 
scale parameter pairs. The processing continues with a call to 
LNTRAN, where the data is transformed. (See section 3.2. 6.6 for 
equation) If rescaling is desired by the statistical method, the 
histogram method, or the user input of parameters method, the 
processing continues with either a call to KBTRAN for the statis- 
tical method, to TRHIST for the histogram method, or to LNTRAN 
for the user- input method. 


i 


If rescaling is not specifically requested by mea»'!is of the 
RESCALE control card, no rescaling of transformed data values 
will be performed. 

3. 2. 1.7 Flowchart 
See Appendix A 

3. 2. 1.8 Listings 
See Appendix B. 

3.2.2 SOFTWARE COMPONENT NO. 2 (SETUPS) 

3. 2. 2.1 Linkages 

SETUPS is called from DATATR. In the process of reading control 
cards, SETUPS may call NXTCHR, FIND. BMFIL, NUMBER, ORDER, CRDSTA, 
FLTNUM, REDSAV, PRTCOV, or WRTBM. 

3. 2. 2. 2 Interfaces 

SETUPS utilizes common blocks GLOBAL, INFORM, j*nd TRBLCK. 

3. 2. 2. 3 Inputs 

Additions to or modification of the input to the SETUPS subroutine 
that result from this data transformation processor modification 
are the control cards OPTION PUNCH, OPTION SCAFAC, BIAS, and 
RESCALE. Control card formats are described in section 4.1, 

User Documentation. 

3. 2. 2. 4 Outputs 

SETUPS outputs a line printer summary of the control card input. 
Input parameters or processing flags as a result of the OPTION 
PUNCH, OPTION SCAFAC, BIAS, or RESCALE control cards are 
returned to DATATR by subroutine argument. 


3.2.2.5 Storage Requirements 

Storage used: Code - 1372g, Data - 303g 

3. 2. 2. 6 Description 

SETUPS reads and analyzes all input processor control cards, 
including any parameter values provided on the control cards and 
sets default values for Data Transformation. Defaults added as 
a result of this specification are: (1) the additive transfor- 

mation bias vector is set > 0 if no BIAS control card is pro- 
vided, and (2) transformed data rescaling is not performed if 
the RESCALE control card is not input. 

3. 2. 2. 7 Flowchart 
See Appendix A. 

3. 2. 2. 8 Listings 
See Appendix B. 

3.2.3 SOFTWARE COMPONENT NO. 3 (SETREM) 

3. 2. 3.1 Linkages 

SETREM is called from DATATR. A Univac system program, CMERR, 
is called by SETREM, to provide an error exit if encountered with 
scale parameters read from the OPTION SCAFAC control card. 

3. 2.3.2 Interfaces 

Communication with DATATR is accomplished via calling arguments. 

3. 2. 3. 3 Inputs 

The inputs to the SETREM subroutine (via calling argument) are 
the scale parameters read from the OPTION SCAFAC control card(s). 


The scaling parameters are ordered pairs on the OPTION SCAFAC 
control card. Each pair is associated with one component of the 
transformed data. The first value in each pair is the multi- 
plicative factor, and the second value in each pair is the trans- 
formed data minimum "M". These scaling parameter pairs are used 
in LNTRAN to scale the transformed data to the range of 0-2SS. 

3. 2. 3. 4 Outputs 

SETREM outputs the scaling parameters to DATATR via subroutine 
arguments, CON and MIN (with CONj^ ■ and MIN^ ■ see the 
description of the OPTION SCAFAC card, section 4.1). 

3. 2. 3. 5 Storage Requirements 

Storage used: Code - 75g, Data - 107g 

3. 2.3.6 Description 

SETREM receives the input scale parameters from DATATR in a 
single array (CONMIN) as they have been read from OPTION SCAFAC 
control card(s) in SETUPS. Since the input scale parameters 
consist of two values — the scaling factor, S ("CON), and the 
additive scaling bias, M (-MIN) - these values must be unpacked 
from the input array and stored in the CON and MIN arrays foi 
use by LNTRAN. SETREM checks to see that there is one -for- one 
correspondence between input scaling parameter pairs and the 
components of the transformation. If the test for input pair 
versus transformation component fails due to too many or too few 
input scale parameter pairs, an error message is printed and 
Data Transformation is terminated by SETREM. The error message 
returned by SETREM is: 

"SETREM ERROR - THERE WERE XX SCALE FACTORS AND MINIMUM VALUES 
INPUT THROUGH SCAFAC OPTION. YY LINEAR COMBINATIONS WERE 
REQUESTED. THERE MUST BE A SCALE FACTOR AND A MINIMUM VALUE 
FOR EACH LINEAR COMBINATION. THE PROGRAM WILL TERMINATE 
THROUGH CMERR." 


3. 2. 3. 7 Detailed Flowcharts 


See Appendix A. 

3. 2.3.8 Listings 
See Appendix B. 

3.2.4 SOFTWARE COMPONENT NO. 4 (TRHIST) 

3. 2.4.1 Linkages 

TRHIST is called from DATATR. TRHIST calls TAPHDR, FSBSFL, 
LAREAD, FLDINT, LINERD, FLDINT, and TRANSF. 

3. 2. 4. 2 Interfaces 

TRHIST utilizes common blocks GLOBAL, INFORM, and TRBLCK. 

3. 2. 4. 3 Inputs 

Input that affects TRHIST is the additive transformation bias 
vector input via the BIAS control card, and used in the trans- 
formation of data as Ax+b, where A ■ the transformation matrix, 

X ■ data, and b ■ bias value from the input BIAS control card. 
Tne input bias vector is transmitted to TRHIST via a calling 
argument, BIAS, added as a result of these modifications. 

3. 2.4.4 Outputs 

There is no change in TRHIST output r:»sulting from this specifi- 
cation. 


3. 2.4.5 Storage Requirements 
Storage used: Code - 744g, Data - 204g 


3. 2.4.6 Description 

The function performed by TRHIST is to compute scaling para- 
meters for the transformed data, using a histogram of the 
transformed data to derive the scaling parameters MAX, MIN, and 
CON. A histogram of a segment of the transformed image is per- 
formed to find the maximum value, MAX^, and minimum value, MIN^, 
for each component of the transformed data. The scale factor, 
CON^, is computed as 25S/(MAXj^ - MINj^). The input (or default) 
PEROUT is applied in TRHIST in obtaining the scaling parameters 
MAX, MIN, and CON. 

If the user defined field is smaller than 2000 pixels, all pixels 
are used in the histogram. Otherwise the following formula is 
used to determine the line increment and sample increment needed 
to obtain 2000 points for the histogram: 

where M - Number of samples per 
line 

N ■ Number of lines 
a ■ increment (integer) 

The input additive transformation bias vector is passed to TRHIST 
by subroutine argument (BIAS) and is used in TRANSF, which is 
called by TRHIST, to provide the transformation Ax*b, with A ■ 
the transformation matrix, x ■ data vector, and b ■ transfor- 
mation bias vector. 

The function performed by TRHIST is invoked by the input RESCALE 
control card when neither of the other two options for rescaling 
(statistical and user-input) are specified. 

3. 2. 4. 7 Flowchart 



See Appendix A. 


3. 2.4.8 Listings 
See Appendix B. 

3.2.S SOFTWARE COMPONENT NO. 5 (LNTRAN) 

3.2.5.1 Linkages 

LNTRAN is called from DATATR. During its processing LNTRAN 
calls LARSYS routines TAPHDR, FSBSFL, LAREAD, FLDINT, WRTHDR, 
LINERD, FLDINT, TRANSF, WRTLIN, and COMHST and UNIVAC system 
routine NTRAN. 

3. 2. 5. 2 Interfaces 

LNTRAN utilizes common blocks GLOBAL, INFORM, and TRBLCK. 

3.2.5. 3 Inputs 

Additional calling argument input to the LNTRAN routine due to 
these modifications include the scaling flags (RESCAL and SCAFLG) 
the punch card flag (NPUN) , the transformation bias values (BIAS), 
and the flag SCAFLG set to indicate the source of the scaling 
parameters MAX, MIN, and CON (SCAFLG ■ 1; histogram, SCAFLG • 2, 
statistical; .‘JAFLG • 3, user- input). 

3. 2. 5. 4 Outputs 

The transformed data set is output on UNIVAC Unit L (Fortran 
Unit 14) as usual. This assignment must be made to tape, if the 
transformed data set is to be saved by the user. The output 
transformed data set file will be in one of two formats, as 
specified on the FORMAT control card. 

3. 2. 5. 5 Storage Requirements 

Storage used: Code - 2130g, Data - 17477g 








3. 2. 5. 6 Description 

The functions provided by LNTRAN are to initiate the transforma- 
tion of the data by a call to TRANSF, to rescale the transformed 
data, histogram the transformed data, apply PEROUT to the distri- 
bution of the transformed data, and output that data to a file, 
TRFORM. Depending on the flag, RESCAL, the transformed data may 
be either rescaled to 0-255 range or output to the file unsealed 
as it is received from the transformation subroutine, TRANSF. 

If rescaling is not performed (RESCAL • 0) the transformed values 
are checked for being within the range 0-255. Any value outside 
the range are set to the range minimum or maximum (0-255). 


If the transformed data is to be rescaled (RESCAL > 0) , rescaling 
is performed in LNTRAN using the following equation: 





for each component i of the trans- 
formed data vector 


where 

MIN ^ ** minimum value for component i 
XTj^ = transformed data point 
CON^ = 255/ (MAX^ - MIN^) 

“ rescaled transformed data point 


If the OPTION PUNCH control card has been input, LNTRAN will 
output to the system punch file vhe card images containing the 
scaling parameters used to rescale the transformed data. The 
punched cards will be in control card format (OPTION SCAFAC*) 
and each card will contain two pairs of scaling parameters 
(CON, MIN). Each pair is associated with one component of the 
transformed data. 










3. 2. 5. 7 Detailed Flowcharts 
See Appendix A. 

3. 2. 5. 8 Listings ' 'i 

See Appendix B. ' 

I 

3.2.6 SOFTWARE COMPONENT NO. 6 (TRANSF) 

3. 2.6.1 Linkages 

TRANSF is called from both TRHIST and LNTRAN. 

3. 2. 6. 2 Interfaces 

TRANSF utilizes common block TRBLCK. 

3. 2. 6. 3 Inputs 

TRANSF receives the tape- input pixels, the transformation bias 
vector, the transformation matrix, and other parameters it 
needs to utilize this information via subroutine argument and 
the common block TRBLCK. The transformation bias vector is input 
to the processor, then to TRANSF, via the BIAS control card. The 
transformation matrix is input to the- processor , then to TRANSF, 
via the B-MATRIX control card. The BIAS control card is discussed 
in section 4.0 below. The B-MATRIX control card is discussed 
in the EOD-LARSYS User Document, LEC-3984. 

3. 2.6.4 Outputs 

TRANSF returns the transformed data value argument to LNTRAN 
(or TRHIST). 

3. 2.6. 5 Storage Requirements 

Storage used: Code 122g, Data 34g 


3. 2.6.6 Description 

TRANSF performs the following linear transformation: 

Z ■ AX ' 

or, optionally, 

•* -*■ 

Z - AX+b 

where 

Z » transformed data vector 

A • transformation matrix; either the B-Matrix or a user- supplied 
transformation matrix 

X ® input data vector 

b » an additive bias vector 

The B-Matrix is a dimension reduction transformation generated 
by the SELECT processor In EOD-LARSYS. The B-Matrix may be input 
to DATA-TR either from a file or a card deck created by the 
SELECT processor. 

A user-supplied transformation matrix must be input in the same 
format as the B-Matrix. The format of the input transformation 
matrix is described in section 3.0 of the EOD-LARSYS USERS DOCU- 
MENT, LEC-3984. 

For the transformation, Z = AX + b, the bias vector, b, is an 
option to the user. The option is exercised and the bias vec- 
tor is input via the BIAS control card. TRANSF performs the data 
transformation, Z = AX, in the absence of the BIAS control card. 

3. 2. 6. 7 Detailed Flowcharts 


See Appendix A. 












3. 2.6.8 Listings 
See Appendix B. 
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4 . OPERATION 


The following section describes the Data Transformation pro- 
cessor as modified per this specification and the processor 
control cards added or revised due to this modification. Opera- 
tion of the Data Transformation processor, utilizing the changes 
described in this specification, is accomplished by use of pro- 
cessor control cards as described below. 


4.1 USER DOCUMENTATION 

The following table contains the options that affect this speci- 
fication, in the form of the processor control cards which are 
added or modified to initiate the design specification. The 
format of these control cards are standard EOD-LARSYS format; 


i.e., the keyword must begin in card 
must begin in or after column 11 and 
column 72: 

KEYWORD PARAMETER CS) 

RESCALE None 

(DEFAULT: No 
rescaling performed) 


column 1, the parameter (s) 
end in or before card 

FUNCTION 

Initiates rescaling of the 
transformed data set to an 
integer range, 0-255. No 
parameters are input on 
this card. The method of 
rescaling will depend either 
on use of another control 
card to indicate the type 
of rescaling (statistical or 
user-input) to be performed, 
or defaulting to the histo- 
gram method if another option 
is not input. 




/i 


KEYWORD 


PARAMETER(S) 


FUNCTION 


OPTION 


SCAFAC-(Sj.Mj), 

(S2 *^2) » * * * » 

N*l, No. components 
of Z 

(DEFAULT: Histogram 
method of rescaling) 


Initiates the use of input 
scaling parameters, to 

be used in rescaling the trans- 
formed data set to a range of 
0-255. The scale parameters 
are ordered to be in correspon- 
dence with the Z (transformed 
data) components which they are 
to be applied to. Each pair of 
scaling parameters is: 

S. “scale factor for component i 
»255/(MAXj-MIN^) 

M. “minimum of component i. 

S. and are decimal (floating 
point) numbers used as: 

Yi “ " ^i ) » where Y^ is 

the rescaled transformed Z, com- 
ponent i. The enclosing paren- 
thesis, "(" and ")", and the 
separating comma, are 

required for each pair of scal- 
ing parameters. The scaling 
parameter pairs are also separ- 
ated by the comma, Blanks 

are ignored on the card. Contin- 
uation of a list of scaling 
parameters is accomplished by 
repeating the OPTION SCAFAC* card, 
with the list of pairs continuing 
from the preceding OPTION SCAFAC“ 
card. 










KEYWORD 

BIAS 


OPTION 


PARAMETER (S) 

bj.b2.---.b^ 

or 

N*bi.bi^j,->* 

k«NO. of components 
in the transformed 
data set 

N»an integer repeti- 
tion factor for b^ 
(DEFAULT: b^ - 0.0 

i * 1 , • • • »16) 

PUNCH 

(DEFAULT: no punched 
output scaling para- 
meters) 


FUNCTION 

bj^ are decimal (floating 
point) numbers, separated 
by a comma, which 
comprise the bias vector 
to be applied in the 
transformation of the 
input data set: 

t - A 

Directs the program to out- 
put punched cards containing 
the scaling parameters, 
(Sj,Mj), which were used to 
rescale the transformed data 
set. 

NOTE: If PEROUT > 0, the out- 
put scaling parameters reflect 
the range of the transformed 
data after application of 


PEROUT. 


5. TEST PROCEDURE 


5.1 DESCRIPTION OF TESTS 

Five runs of the modified data transformation processor will be 
used to verify the output of the processor. The output from 
each of the five test runs is contained in Appendix C. TEST 
RUN 1 is headed by "SAMPLE RUN NO. 1", TEST RUN 2 is headed by 
"SAMPLE RUN NO. 7", TEST RUN 3 is headed by "SAMPLE RUN NO. 2", 
TEST RUN 4 is headed by "SAMPLE RUN NO. 5", and TEST RUN 5 is 
headed by "SAMPLE RUN 6". In all test runs, the transformation 
matrix following the "B-MATRIX CARDS" control card is a unit 
matrix. 

TEST RUN 1 illustrates the default no-reading option (no "RESCALE" 
control card input), with no distribution trunication (PEROUT**0) , 
and no bias applied to the transformed values (BIAS«[0]). With 
the unit transformation matrix applied, the histogram for each 
of the four components reflects the actual data values in each 
of the four channels. 

TEST RUN 2 is the same as TEST RUN 1, except a selective additive 
bias is applied to the transformed data. Components 1 and 3 have 
no bias applied and the transformed values of components 2 and 4 
are biased by +100 and -100, respectively. The histograms for 
this run illustrate the results of application of a transforma- 
tion bias which is input via the "BIAS" control card. 

TEST RUN 3 illustrates the results from the statistical rescaling 
option ("MODULE" and/or "STATFILE" control cards), with the 
initial range of transformed values constrained to be within 2 
sigma (LAM>2) of the mean of each component, and the final out- 
put transformed values constrained to be within the central 90% 
of the distribution of the initial transformed values (PEROUT-5). 


The histogram of each component of the final output transformed/ 
rescaled values will be compared for agreement with results from 
the unmodified data transformation processor, using the statis- 
tical rescale method. The histograms should be identical, 
except for allowance for the slight difference in scaling 
parameters due to the fact that the unmodified processor computed 
a scaling factor based on a range of 0-256, and the modified 
processor computes a scaling factor based on a range 0-255. 

TEST RUN 3 also exercises the option of punching the scaling 
parameters ("OPTION PUNCH") computed and applied in the run. 

The punched cards from this run will be input in TEST RUN 4. 

TEST RUN 4 illustrates rescaling of transformed values with user- 
input scaling parameters ("OPTION SCAFAC=XX.X, ..."). 

The input scaling parameters are on processor control cards 
punched in TEST RUN 3. The histograms for TEST RUN 3 and TEST 
RUN 4 will be compared for agreement. The results should be 
identical, except for slight differences due to round-off of 
the input scaling parameters to three decimal places, compared 
to the eight decimal place values internally computed and applied 
in TEST RUN 3. 

TEST RUN 5 illustrates rescaling by the histogram method. The 
histograms will be compared with histograms from the unmodified 
processor using the histogram rescale method. The histogram 
should be identical, except for slight differences reflected by 
the change of rescaled value range from 0-256 in the unmodified 
processor to a range 0-255 in the modified processor. 
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APPENDIX A 

DATA TRANSFORMATION FLOWCHART 
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